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Abstract 

The ability of nonlinear dynamical systems to process incoming 
information is a key problem of many fundamental and applied sci- 
ences. Information processing by computation with attractors (steady 
states, limit cycles and strange attractors) has been a subject of many 
publications. In this paper we discuss a new direction in information 
dynamics based on neurophysiological experiments that can be ap- 
plied for the explanation and prediction of many phenomena in living 
biological systems and for the design of new paradigms in neural com- 
putation. This new concept is the Winnerless Competition (WLC) 
principle. The main point of this principle is the transformation of 
the incoming identity or spatial inputs into identity-temporal output 
based on the intrinsic switching dynamics of the neural system. In the 
presence of stimuli the sequence of the switching, whose geometrical 
image in the phase space is a heteroclinic contour, uniquely depends 
on the incoming information. The key problem in the realization of 
the WLC principle is the robustness against noise and, simultaneously, 
the sensitivity of the switching to the incoming input. In this paper we 
prove two theorems about the stability of the sequential switching and 
give several examples of WLC networks that illustrate the coexistence 
of sensitivity and robustness. 

Paper in press for 'International Journal of Bifurcation and 
Chaos' (2004), Vol. 14 (4). 
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1 Introduction 



Computing with a dynamical system implies that this system changes its 
behavior depending on the quality and quantity of the incoming information. 
This is an enormous field and we will concentrate here only on the concept 
of Winnerless Competition (WLC) that, as we think, is a general principle 
for information processing by dynamical systems. 

Information processing with WLC dynamics is a new area for theoret- 
ical study. However, WLC itself has already been observed in many well 
known experiments in hydrodynamics [Busse & Heikes, 1980], population bi- 
ology [May & Leonard, 1975] and laser dynamics [Roy, 1999]. For example, 
the convective roll patterns in a rotating plane layer demonstrate a sequen- 
tial changing of direction as a result of the competition between different roll 
orientations (when the rotation rate is large enough, e.g. Kuppers-Lortz in- 
stability [Kiippers & Lortz, 1969]). For a large Prandtle number the critical 
angle is close to 60° (for the steady state rolls it is 120") . Due to the appear- 
ance of new rolls that are also unstable, no pattern becomes a winner and, as 
a result of the competition, they switch sequentially. Small non-Boussinesq 
effects are able to make such sequence periodic [Rabinovich et al., 2000a]. 

The discussed process can be described by Lottka-Volterra equations that 
are well known in population biology and can explain the competition be- 
tween three spices [May & Leonard, 1975]: 

cti = ai[l - (oi + Pi2a2 + pisos)] 

02 = a2[l - (^2 + P2iai + ^2303)] 

03 = a3[l - («3 + P3iai + ^3203)] 

In biology the variable ai{t) is the number of individuals in the i-th pop- 
ulation at time t, and pij are competition coefficients measuring the extent to 
which the jth species affects the growth rate of the i-th species. In convec- 
tion, the variables are the intensities of the competitive modes: a, = |cjp, 
and we suppose that the vertical component of the velocity field is (in the 
limit of small amplitudes) — fiz)J2^=iCj{t)exp{i\s.j • r}, where z is the 
component of the position vector r in the vertical direction and are the 
wave vectors [Busse & Heikes, 1980; Rabinovich et al., 2000a]. 

The non-symmetry of the coefficients pij, for example pu = P23 = P31 = 
p+ > 1, P21 = P32 = Pi3 = P- < 1, guarantees the WLC behavior of 
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the discussed dynamical system. The mathematical image of such behavior 
is a heteroclinic contour in the phase space ai{t), 02 (t), asit) (see Fig. 1). 
Results related to symmetric cases have been reporter earlier [Ashwin and 
Field, 1999] and [Ashwin and Chossat, 1998]. 

The questions that we are going to discuss below are: (i) what are the 
conditions for the robustness of the WLC, i.e. the topological similarity of 
the perturbed and original heteroclinic contour; and (ii) how subsystems with 
WLC behavior interact with each other. 

The paper is organized in the following way. First we describe a class of 
models that use the WLC principle for the representation and processing of 
incoming information (Sec. 2). Then we discuss the existence and stability 
of the heteroclinic contour (Sec. 3), and the robustness, i.e. birth of a stable 
limit cycle in the vicinity of the destroyed heteroclinic loop in a perturbed 
system (Sec. 4) with some examples from computer modeling. Finally we 
discuss several WLC strategies used by living neural systems to perform 
complex information processing (Sec. 5). 

2 The Models 

The activity of many different neural networks [Rabinovich et al., 2001; 
Varona et al., 2001; Abeles et al., 1995; Cohen & Grossberg, 1983], can 
be described qualitatively with the following dynamics: 

N 

a, = ai{a{H,S)-J2Pij(^J + Hi{t)) + Si{t) (1) 

where > represents the instantaneous spiking rate of the principal neu- 
rons (PNs) that are making the computation, pij, represents the strength of 
inhibition in i by j, Hi{t) represents the action from other neural ensembles, 
and Si{t) represents the stimuli from the sensors. In many neural networks, 
the inhibition among PNs is the result of the action of inhibitory local neu- 
rons (LNs). Usually LNs also receive an external input and because of this 
Pij can depend on the stimuli. 

The dynamical system (1) in the case a = 1, H{t) = S{t) = is the 
Lottka-Volterra model. The dynamics of the system is well known when the 
matrix pij is symmetric {pij = pji). In this case the autonomous system has 
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a global Lyapunov function [Cohen & Grossberg, 1983; Hopfield, 1982] and 
every trajectory approaches one of the numerous possible equilibrium points. 
For example, if the inhibitory connections are identical, pij — p, pu — 1, this 
system has only one global attractor, e.g. Oj = Qq = 1/[1 + p(A^ — 1)] 
for p < 1, and attractors: ai = = 1, aj-^i = if p > 1. No other 
attractors, e.g. limit cycles, or strange attractors are present in the system. 
The situation is much more complex and interesting when the inhibition is 
non-symmetric: pij ^ pji. A detailed analysis is only possible in the case 
N = 3 (see references [Afraimovich et al., 2001; Chi et al., 1998; Rabinovich 
et al., 2001]). When pij > l,pji < 1 there exists a heteroclinic contour 
in the phase space of the system that consists of saddle points and one- 
dimensional separatrices connecting them. In some regions of the parameter 
space {pij}, such heteroclinic contour (or limit cycle in its vicinity) is a 
global attractor. If p^j depend on the stimulus, e.g. as a result of a learning 
mechanism, the system (1) can generate different heteroclinic contours for 
different stimuli [Rabinovich et al., 2001]. 
Suppose the matrix 

/I ai A \ 

(Pij) = \ P2 1 ^2 

V «3 /93 1 / 

and < ai < 1 < Pi and = (/3j — 1)/(1 — aj). Then the heteroclinic contour 
is a global attractor if ki-K2-K3 > 1, and the nontrivial fixed point A{a1, ag, a^) 
is a saddle point, li Ki ■ K2 ■ K3 = 1, this fixed point becomes neutrally stable 
and there exists a family of neutrally stable periodic solutions in the phase 
space. When Ki ■ K2 ■ K3 < 1, A becomes a global attractor. The heteroclinic 
orbit exists but looses its stability. It is important to emphasize that in the 
case Ki • K2 • Ks > 1 a small perturbation is able to destroy the heteroclinic 
orbit and then a stable limit cycle appears in its vicinity. This limit cycle is 
characterized by a finite time period of switching among different states, in 
contrast with the infinite time of motion along the heteroclinic loop. 

When N > 3 the dynamics of system (1) can be very complex and even 
chaotic [Varona et al., 2001]. Here we are interested in the existence and sta- 
bility of the heteroclinic contours, which are the mathematical image of the 
winnerless competition behavior. Such orbits may exist only in the nonsym- 
metric case e.g. pij 7^ pji, when saddle points (in the heteroclinic contours) 
satisfy several conditions. 
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3 Existence and Stability of the Heteroclinic 
Contour 



In this section we consider the canonical Lottka-Volterra model 

N 

hi = ai[l- {ai + ^pijaj)\, (2) 

and derive conditions of existence and stability of heteroclinic contours. 

3.1 Necessary Conditions 

3.1.1 " Codimension one" saddle points 

A heteroclinic contour consists of finitely many saddle equilibria and finitely 
many heteroclinic orbits connecting these equilibria. Let's denote by Ai 
the equilibrium point (1, 0, 0, 0), by A2 the point (0, 1,...0), and by A^r 
the point (0,0,...,!). For the sake of simplicity we assume that there is a 
heteroclinic orbit Fji+i connecting the points and Aj+i, i = 1,...N and 
An+1 = Ai. (If not, we can always apply a change of variables in the form of 
a permutation) . The contour can serve as an attracting set if every point A^ 
has only one unstable direction. By direct verification it can be shown that 
Ai satisfies this assumption provided that: 

Pki > l,k i + (3) 

and 

Pi+li < 1- (4) 

(Herei + l = lifi = A^). 

Moreover, if (3) and (4) are satisfied then the unstable direction at the 
point Ai is parallel (at that point) to the ort (0...010...0), where 1 corresponds 
to the i-th coordinate. An intersection of hyperplanes P2i = njLij^i,i+i{% = 
0} is a two-dimensional invariant manifold containing points Ai and Aj+i such 



5 



that Ai is a saddle point on and 74^+1 is a stable node on P2i- The system 
(2) on has the form: 

di = ai[l - {tti + pii+iai+i)] (5) 
dj+i = ai+i[l - [tti+i + pi+iitti)] (6) 

and, from (3) and (4), one has pa^i > 1, Pi+ii < 1. 

This implies that there are no equilibrium points in the region > 0, 
Cj+i > 0, and since dj+i < if Oj+i ^ 1 then it is simple to see that the 
separatrix, say Fj of the saddle point must go to the attractor Aj+i, i.e. 
there is a heteroclinic connection between Ai and ^j+i on the plane (For 
the case N=3 see the proof in [Waltman, 1983]). 

3.1.2 Leading directions 

The point Ai on is a stable node with characteristic numbers Ai = — 1 
and A2 = 1 — Pii+i- The leading direction at Aj+i is determined by the 
absolute values of Ai and A2: if Ai > A2 then the leading direction is parallel 
to the Cj+i-axis, and if Ai < A2 then the leading direction is transversal to 
the Cj+i-axis on P2i- We assume that the last inequality holds, i.e. 

Pn+l < 2, (7) 

then the majority of orbits, (including Fj) go to Aj+i following a direction 
/ = (1, — pj+ij/(2 — Pii+i)) transversal to the aj+i-axis. 

— * 

The vector I on P2i can be embedded into the hyperplane Hi : {aj+2 = 0} 
as L = (00. ..1, —pi+ii/ (2 — pjj+i), 0...0), 1 on the i-th place, and one can ask if 

— * 

the direction L is the leading direction for the node ^j+i on this hyperplane. 

To see sufficient conditions for that assumption we have to take into account 
that the characteristic numbers at point Aj+i of the system (2) restricted to 
the hyperplane {ai+2 = 0} are 1 - pa+i, 1 - pi-u+i, -1, 1 - Pi+2i+i, 1 - 
Pm+i (they are all negative because of (3)). Hence, if 

Pki+i > Pii+i, k j^i, (8) 

— * 

then 1 — pii+i is the characteristic value closest to zero and L is the leading 
direction at Aj+i on Hi. We assume that (8) is satisfied. This condition is 
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not necessary for the validity of the results below, but it essentially simplifies 
the description of the results and calculations. 

3.1.3 Saddle values 

The point Ai is a saddle point on P2i- One can write a map from a transversal 
to the stable separatrix into a transversal to the unstable separatrix along 
the orbits going through a neighborhood of Ai (see for instance [Shilnikov et 
al., 2001]). In suitable coordinates {Cv) it has the form: 



^ = cv"' (9) 

where is a deviation from the stable manifold, is a deviation from the 
unstable one, c is a constant and 



Vi = = (10) 

J- — Pi+U J- — Pi+U 

is the "saddle value" ([Shilnikov et al., 2001]). If i/j > 1 then the map (9) is 
a local contraction and Pj is a dissipative saddle. If i/j < 1 then (9) is a local 
expansion. 

3.1.4 Stability of the heteroclinic contour 

The following result tells us that the contour F = Uili Tj U A^ can be an 
attr actor. 

Theorem 1 Assume that conditions (3), (4), (7), (8) are satisfied and 



^ n - 1 

-=nf^>i (11) 

.•1 J- — Pi-\-M 



i=l 



(here i + \ = lifi — N). Then there is a neighborhood U of the contour 
r such that for any initial condition a° = (a^, •••,a^) in U with > 0, one 
has dist{a{t), F) — >• as t — >• oo where a{t) is the orbit going through a°. 



7 



3.2 Proof of Theorem 1 



The proof of the theorem is based on the construction of the Poincarc map 
along orbits in a neighborhood of the contour F. Let Wf (W^) be a stable 
(unstable) manifold of the point Ai and Pj (Qi) be a point on the heteroclinic 
orbit Fj-i (Fj) in a small neighborhood of AiSee Fig 2. 

3.2.1 Local map 

Let Sp^ {SQ^) be a piece of a transversal to Fi_i (to Fj) hyperplane going 
through Pi (through Qi). Without loss of generality, we may assume that 
Sp^ is a piece of a hyperplane, parallel to the hyperplanes aj+i=o- A local 
map fi : Sp. Sq^ along orbits in a neighborhood of Ai is well defined. In 
suitable coordinates it has the form [Shilnikov et al., 2001]. 



= CiT]-', Xi = ^iiVi, Vi) (12) 

where r^, e 3? is a coordinate on 5'p., "parallel" to W", y e 3?^~^ is a 
vector-coordinate transversal to the r^j-axis on Sp^, is a coordinate on Sq^, 
"parallel" to the leading direction on Wf at Ai, yi is a vector-coordinate 
transversal to the (^j-axis on SQ^. Moreover, 



diji ' drj, 

where Ci > is a constant and 



< Qr?f , | — I < Ci\yi\ ■ \r]i\''' (13) 



A > (14) 

3.2.2 Global map 

The heteroclinic orbit Fj has a piece joining the points Qi and Pj+i- Thus, 
the global map Fi : Sq^ 'S'pj+i along orbits in a neighborhood of this piece 
is well-defined where Sq. C Sq^ is a small neighborhood of the point Qi on 
Sq^. This map is a diffeomorphism and has the form 
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(15) 



where the dots denote nonhnear terms. The orbit Fj belongs to the inter- 
section of invariant hyperplanes {aj = 0}, j i, j ^ i + 1. Therefore the 
hyperplane {^j = 0} on SQ^ is mapped by Fj into the hyperplane {rji+i — 0} 
on Sp^_^_^ which means that = in (15), and 

an ^ (16) 

Hence (15) has the form: 

77i+i = aiii + ... 

Z/i+i = &io + &ii6 + ^'i26 + -- , (17) 

Oil ='■ Oi- 

3.2.3 Poincare map 

We may construct a Poincare map F — Sp^ — > Sp^ as the superposition of 
maps fi, Fi, i.e. F has the form F ^ Fn ■ /n ■ - ■ F2 ■ f2 ■ Fi ■ fi. 
The map Fj o /j has the form 



Vi+i = hio + hiCirfi' + bi2(pi{yi, rji) + ... (18) 

So, in this approximation the form of the map F along the r^-coordinates is 
independent of the |/-coordinates , and one may consider the one-dimensional 
approximation 

7/i+i = aiCir]i',i = 1,...,N (19) 
Vn+1 ■■= Vi = F{r]i) 
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It is simple to sec that the map F : r^i ^ f^i is a contraction provided 
that condition (11) is satisfied. Indeed, it follows from (19) that rji = Arji, 
where ^4 is a constant and u — n^li i^i- Hence ii u > 1, then dffi/drji < 1 if 
rji is small enough, the map (19) is a contraction and 771 = is an attracting 
fixed point (corresponding to the contour F). 

Consider now the map o /j. The differential 

(CliCiVjTll^^ ^ ~t~ • • • ~t~ . . . \ 

0^lC^V^r]^ + 0^2 + ••• + ■■■ J 

and because of (13), (14), 

\\DF,of,\\<Bir)r' (21) 
where Bi is a constant. Since DF — n^li D{Fi o /,), then 

JV 

\\DF\\<Bl[7]-^-^ (22) 

i=l 

where B = Jlili -Bj- We estimate now nili^i"*"^ by using (18). In the 
expression i]'^^^ ■ r]'^Si~^ ■ ... ■ 'r]2^~^ • iji^'^ let us estimate first ri2^~^ ■ Vi^~^- 
Since rj2 = aiCir^r + -, then rj^''^ ■ r]l'-^ = {aiCiY^-^ ■ (r^^ + -)"'"' ' < 
const ■ r]\^^'^~^. 

Now 7/^3-^ -r/^^^^-r^i^i"^ = {a2C2Y''-^ ■ {ri^" + ...Y''-^ -tiI^'^ < const ■ r)^''''^''^ ■ 
ryj'i-i = const • {aiCiY"'^-\7]'(' + ...Y'""'~^ ■ Vi''^ < const ■ r;J'3-^2i^i-i_ 

Assume (inductively) that r)'j^''~^ • ... • t)2^~^ ^ const • r)2''"''^^~^ , then rj'j^'''^ ■ 
• •• ■ V2"'^ ■ < const ■ {aiCiTji' + ...)^*-''2-i . ^j'l-i < ^.^nst ■ rflti''-^ 
and therefore, 

N 

llvr'<C-Vi-' (23) 

i=l 

where C is a constant. Hence, 



\DF\\ < BCr]'i-\ 
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(24) 



i.e. F is a contraction in a neighborhood of the point rji = 0, yi = 
corresponding to the contour T. 

This concludes the proof of Theorem 1. 

3.3 Selecting the Contour 

In this subsection we show how the canonical system (2) can be obtained from 
a general system for a neural network with inhibitory connections. Suppose 
that the dynamics of a network of iV + Af inhibitory neurons with dynamical 
variables yi{t) = {yl;^\t), ...,yl"^\t)),i = 1, N + M can be described in the 
form of the following system of ODEs: 

N+M 

y, = F{y,)- + (25) 

where F is a nonlinear function that describes dynamics of individual neu- 
ron, Gij{S){yi,yj) is a nonlinear operator describing an inhibitory action 
of the j-th neuron onto the i-th neuron, S{t) = {Si{t), SN+M{t)) and 
{Si{t), SN+M{t)) are the vectors representing stimuli to the network. We 
restrict ourselves to a subclass of systems (25) represented in the form (1). 
It is known (see above) that a stimulus acts in two ways: (i) it adds the 
perturbation S{t) into (25) as an external force, and (ii) it forms the matrix 
Gij{S). A simplified model that describes the firing rate of the neurons can 
be written in the form (1) [Rabinovich et al., 2001], where a = —1 when there 
is no stimulus, and a — 1 when the stimulus has a component at neuron i. 
In the absence of the external force S{t) the system (2) is just a subsystem 
of (1) for which all a = +1. 

We describe now an algorithm to obtain the system (2) from (1) (provided 
that S{t) = 0). First of all we single out only indexes i for which ai{S) = +1. 
As a result we obtain a system which has the form: 

N+Mi 

hi = ai[l - (aj + Pijaj)] (26) 

with Ml < M . Then we consider the only those indexes i for which conditions 
(3) and (4) are satisfied. After some permutation we have the system 
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N+M2 



(27) 



with M2 < Ml. Let us form a graph G now: its nodes are equihbrium 
points of (27), e.g. points Ai = (O...Oi = 10...). There is an edge starting 
at the point Ai and ending at the point Aj if there is a separatrix (a piece 
of Wi) joining and Ai and Aj. Thus, for any point Ai there is the only one 
edge starting at Aj. It imphes that there exists a subgraph of this graph in 
the form of a cycle that contains, say, N vertices. The equation describing 
dynamics of N corresponding neurons has exactly the form (2) (maybe after 
some permutative change of variables). 

4 Birth of a Stable Limit Cycle 

A direct corollary of Theorem 1 is the possibility of the birth of the stable 
limit cycle in system (2) when perturbed in an appropriate way. A pertur- 
bation should act in such a way that a Poincare map Sp^ Sp^ for the 
perturbed system has an absorbing region and a fixed point inside it. Such a 
condition can be expressed differently. Let us do it as follows. Consider the 
system 



that coincides with (2) for e = 0, where a = (ai, ...,a7v) and is a smooth 
function, i = 1, ...,N. For small e > the system (28) has saddle equilibrium 
points Ai^ and separatrices Fig (the half of such that /Ijg — >• Ai, as e — >• 
and Ite^oTif: D Fjj+i (here It means the topological limit, i.e. the set of the 
accumulation points). 

Theorem 2 Assume that the conditions of Theorem 1 are satisfied, 



N 



ai = ai[l - {ai + + 



(28) 



N 



Zi,^o(Ur*.) = r 



(29) 



i=l 
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and at least one of the separatrices Ti^ is not a heteroclinic orbit. Then for 
any sufficiently small e > the system (28) has a stable limit cycle (in a 
neighborhood ofV) such that H^^qL^ — F. 

The proof of this Theorem can be done in the standard way, i.e., by 
construction of the Poincare map and by showing (as in the proof of Theorem 
1) that this map is a contraction in an absorbing region. The condition (29) 
(or a similar condition) is necessary and sufficient for the existence of an 
absorbing region. We omit the proof in the present work, since it is really 
a standard one (the corresponding technique can be found in [Shilnikov et 
al., 2001; Afraimovich et al., 1998; Afraimovich et al., 2001]. Thus, one 
may say that the system under consideration is robust in the following sense: 
the attractor of a perturbed system remains in a small neighborhood of the 
"unperturbed" attractor. 

Numerical results show that the system (28) where ^'j(a) > satisfies the 
condition (29) and has a stable limit cycle. An example is shown in Fig. 3. 
In particular, it is clear from this figure that the system has the only one 
-global- attractor. In this example, the simulations were performed with the 
following equations: 

di = ai(l - ^ Pijaj) + eaiai+3 (30) 

where i = 1, 2, 6 and i + 3 = i — 3ifi>3. We used the following values 
of the connection matrix pij ^ 0: 

Pl,3 = P3,5 = P5,l = 5; P4,6 = P2A = P6,2 = 2 
Pis = P2,l = P3,2 = P.1.3 = P5A = P6,5 = 1-5 

Pl,l = P2,2 = P3,3 = Pi,4 = P5,5 = P6,6 = 1 (31) 

with e = 0.01. 

Time series showing the switching of activities displayed in this system 
by the WLC are depicted in Fig. 4. 



13 



5 WLC in Real Neural Systems 



In this section we describe two examples of living neural systems that appear 
to use WLC strategies to process sensory information. As we discussed in 
the Introduction, sensory systems need both robustness and sensitivity to 
acquire and process incoming signals. The WLC among sensory neurons 
guarantees the coexistence of these essential characteristics and can explain 
the experimental recordings in several sensory systems. We will illustrate 
two of these sensory systems using models with WLC dynamics. 

5.1 WLC in Olfactory Processing 

Observed features of olfactory processing networks [Wchr & Laurent, 1996; 
Laurent et al., 2001] can guide the study of computation using competitive 
networks. In Fig. 5 we show the simultaneously recorded activity of three 
different projection neurons (PNs) in the locust olfactory system, i.e. anten- 
nal lobe (AL), evoked by two different odors: despite similar PN activities 
before the stimulus onset (the result of the action of noise) each odor evokes 
a specific spatio-temporal activity pattern that results from interactions be- 
tween these and other neurons in the network [Laurent et al., 2001; Bazhenov 
et al., 2001; Rabinovich et al., 2000b]. 

As we have discussed, WLC networks produce identity-temporal or spatio- 
temporal coding in the form of deterministic trajectories moving along het- 
eroclinic orbits that connect saddle fixed points or saddle limit cycles (see 
Fig. 1) in the system's state space. These saddle states correspond to the ac- 
tivity of specific neurons or groups of neurons and the separatrices connecting 
these states correspond to sequential switching from one state to another. 

Prom the experimental results [Wehr & Laurent, 1996; Laurent et al., 
2001] we infer that a stimulus acts in two principal ways: (1) it excites a 
subset of projector neurons; (2) it modifies the effective inhibitory connec- 
tions between the projector neurons as a result of activation of the inhibitory 
interneurons that connect different PNs. The intrinsic dynamics of these 
neurons is governed by many variables corresponding to ion channels and 
intracellular processes. Such detailed description however is not needed to il- 
lustrate the principle of "coding with separatrices" . We need only to capture 
the 'firing' or 'not-firing' state of the component neurons. We thus simplify 
our model to an equation for the firing rate ai{t) > of neural activity [Ra- 
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binovich et al., 2000b]: 



ai{t) = ai{t) 



, N 



+ S,{t). (32) 



where Pij{S) is the strength of inhibition of neuron j onto i. ^^(S) = — 1, 
when there is no stimulus, and cr(S) = +1 when the stimulus has a component 
at neuron i. When (jj = —1, the quiet resting state Oj = is stable. When 
a stimulus is applied and CTj = +1, the system moves away from this quiet 
state onto a sequence of heteroclinic trajectories. This instability triggers 
the system into rapid action, provides robustness against noise and allows a 
response independent of the state at stimulus onset. 

When the inhibitory connections are not symmetric, the system with N 
competitive neurons has different closed heteroclinic orbits that consist of 
saddle points and one dimensional separatrices connecting them. Such hete- 
roclinic orbits are global attractors in phase space and are found in various 
regimes of the Pij{S). This implies that if the stimulus is changed, another or- 
bit in the vicinity of the heteroclinic orbit becomes a global attractor for this 
stimulus. Such rich behavior can be illustrated also by an inhibitory ensem- 
ble of spiking neurons. We have studied a network of inhibitory connected 
FitzHugh-Nagumo neurons (i = 1,2, ...,9) [Rabinovich et al., 2000b]: 

Tl^^ = f{x^{t))-y^it)-Z^{t){x,{t)-u)+0.35 + Si 



dt 
dyjit) 

dt 



= Xi{t) - byi{t) + a 



= T.9,^G{xM-^^it) (33) 

Here we use a dynamical model of inhibition: Zi{t) is a synaptic current 
modeled by first order kinetics. The variable Xi{t) denotes the membrane 
potential, yi{t) is a recovery variable, and f{x) = x — ^x^ is the internal FN 
nonlinearity. The stimulus is taken as a constant. We use a step function 
for G{x) = 0,x < 0,andG(,T) = l,a; > 0, as the synaptic connection. Si is 
the stimulus, and gji, the strength of synaptic inhibition: gji = 2 if the j^^ 
neuron inhibits the i*^; otherwise. The other parameters are a = 0.7,6 = 
0.8, Tl = 0.08, r2 = 3.1, = -1.5. 
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Our numerical simulations show that the network produces different spatio- 
temporal patterns in response to different stimuli. Fig. 6 presents examples 
of these activities corresponding to two different stimuli. The system was 
in the resting state Xi ~ — 1.2,yj Ki — 0.62,Zj = before the stimulus be- 
gan at t = 0. As one can see, the patterns are considerably different and 
distinguishable. The heteroclinic contour in this network consists of a finite 
number of saddle limit cycles and the same number of heteroclinic orbits 
connecting these cycles (see, as an example. Fig. 1, right panel). A detailed 
characterization of this network as an information processing device has been 
reported in [Rabinovich et al., 2001]. 

5.2 WLC in the Gravimetric Neurons of the MoUusk 
CUone 

Neural networks with WLC dynamics are able to generate new informa- 
tion to answer a simple external signal. Such information can be used for 
the organization of complex activity and, in particular, chaotic behavior of 
some animals. Let us consider now the hunting activity of a marine moUusk 
Clione. This moUusk is a predator lacking a visual system. It feeds on a 
small moUusk, Limacina. The hunting behavior is a random search for prey: 
Clione "scans" the surrounding space in order to locate and catch the prey. 
Such behavior is turned on by the smell of the Limacina. The main role 
in the organization of such motion of Clione is played by a sensory neural 
network inside the gravimetric organs: the statocysts (see Fig. 7). These spe- 
cial sensory organs are responsible for the orientation in the gravitational 
field [Arshavsky et al., 1993]. 

It is well known from the physiological data that the statocysts have up 
to 12 receptor neurons (SRNs) that are coupled with inhibitory synapses [Ar- 
shavsky et al., 1993]. These neurons respond to the pressure exerted by the 
statolith, a stone located inside the statocyst. If no information about a 
prey (received by the chemical receptors) is present, the receptor neuron D 
(down, sec Fig. 7) is excited by the statolith and it inhibits other SRNs, and 
the network responds in a winner-takc-all mode. As a result, the information 
generated by D SRN arrives to the corresponding Central Pattern Generators 
(CPGs) that control the tail and wing movements. These CPGs establish the 
habitual "head up" position of Clione^s body. However if a special Hunting 
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Central Neuron (HCN) receives a message from the chemo-sensors about the 
presence of a prey, HCN excites the SRNs organizing a WLC among them 
as we will illustrate with a model. The behavior of the Clione in this case 
does not depend on the direction of the gravitational field and it moves in a 
random-like trajectory. 

For the phenomenological modeling of the statocyst "hunting" dynamics 
we can neglect the statolith inertial dynamics and take into account the 
only key point: the position of the moUusk's body uniquely depends on 
the message that SRNs are sending to the central neurons that produce the 
commands to the CPGs. Thus, as a starting point, we consider just a SRN 
network under the action of the HCN excitation. We suppose that, as a result 
of the HCN stimulation, aU SRNs ("left", "right", "back", "front", "down", 
and "up") are in the same situation: they receive and send two inhibitory 
synapses (see Fig. 7, right panel). 

The dynamics of the SRN's network can be described by model (1) with 

= 6. In this case, > represents the instantaneous spiking rate of 
the receptor neuron i, Hi{t) represents the stimulus from the hunting neuron 
to neuron i, and Si{t) represents the action of the statolith on the receptor 
that is pressing. When there is no stimulus from the hunting neuron (Hi — 
0,Vi) or the statolith [Si = 0,Vi), then cr{H,S) = —1 and all neurons are 
silent; (y{H , S) = 1 when the hunting neuron is active and/or the statolith 
is pressing one of the receptors. In our simulations, we have used the values 
pij ^ specified in (31). 

When there is no activation of the sensory neurons from the hunting 
neuron, the effect of the statolith {Si ^ 0) in this model is to induce a higher 
rate of activity on one of the neurons (the neuron i where it rests for a big 
enough Si value). We assume that this higher rate of activity affects the 
behavior of the motoneurons to organize the head up position. The other 
neurons are either silent or have a lower rate of activity and we can suppose 
that they do not influence the posture of Clione. 

When the hunting neuron is active a completely different behavior arises. 
We assume that the action of the hunting neuron overrides the effect of 
the statolith and thus Si ~ 0,Vi. The dynamical system (1) with the pij 
values specified above (see also Fig. 7) and with a stimuli from the hunting 
neuron given, for example, by Hi = (0.730,0.123,0.301,0.203,0.458,0.903) 
has a strange attractor in the phase space (see Fig. 8). This means that 
the SRN network generates new information (a chaotic signal with positive 
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Kolmogorov-Sinai entropy) in the presence of the prey, which controls the 
CPGs and, in fact, organizes the random-hke behavior of Clione. 

The origin of the chaoticity in such dynamical system can be explained 
in the following manner [Varona et al., 2001]: due to the diversity in the 
strengths of the inhibitory connections we may consider the complete net- 
work as two weakly coupled WLC triangle networks. Independently each of 
them has a closed heteroclinic contour (see Fig. 7), which becomes a limit 
cycle under the action of a small perturbation (see Sec. 4). The periodic 
oscillations corresponding to these limit cycles have, in general, different fre- 
quencies that are extremely sensitive to the distance to the heteroclinic loop 
in the non perturbed system (such oscillations are strongly non- synchronous). 
As we showed the weak interaction of these WLC triangles (nonlinear oscil- 
lators) generate chaos in wide regions of the control parameter space. New 
experiments have confirmed the validity of the model and its predictions [Levi 
et al., 2002]. 
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6 Discussion 



The stimulus dependent sequential switching of neurons or group of neurons 

(clusters), named WinnerLess Competition, is able to solve the fundamental 
contradiction between sensitivity and robustness of the sensory recognition. 
The key points on which the WLC networks are based are: (i) the hetero- 
clinic contour corresponding to a specific sequence of switching has a large 
basin of attraction, i.e. a specific sequence is stable; and (ii) the topology 
of the heteroclinic contour sensitively depends on the incoming signals, i.e. 
high resolution or sensitivity. Both features are actually present only in the 
case if under the action of a perturbation the discussed heteroclinic contour, 
which is structurally unstable, is transformed to the limit cycle in its vicin- 
ity with the same topology as the contour. In this paper we have discussed 
the conditions for such topological stability, and we have showed that com- 
puting with separatrices based on the WLC principle is a very natural and 
powerful strategy for information processing in real neural systems. Any 
kind of sequential activity can be programmed by a network with stimulus 
dependent nonsymmetric inhibitory connections. It can be the creation of 
spatio-temporal patterns of motor activity, the transformation of the spa- 
tial information into spatio temporal information for successful recognition 
and many other computations. In addition, we wish to mention that two 
important computational functions can be successfully implemented by com- 
putation with separatrices. These are: (i) sequential memory storage, and 
(ii) feature binding. 

In reference [Seliger et al., 2003] the authors suggest a new biologically- 
motivated model of sequential spatial memory which is based on the WLC 
principle. Each stimulus event (visual image, odor, etc..) is represented 
by a saddle point in the phase space of the system, and a network of one- 
dimensional separatrices leads the system along the sequence of events in 
the specific episode. After the learning process, such system is capable of an 
associative retrieval of the pre-recorded sequence of spatial patterns. 

A binding problem occurs when two (or more) different events, e.g. scenes, 
features, or behaviors are represented by different neural ensembles simulta- 
neously, and for some reason they are all connected with each other. Even- 
tually, these coherent features are integrated by the nervous system of the 
animal onto a perceptual object, even if the features are dispersed among 
different sensory systems or subsystems. The binding is ubiquitous and oc- 
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curs whenever a simultaneous remembrance or representation is important. 
The most common approach in the modehng of binding is to involve time 
in operation (von der Malsburg, Singer, and others). The idea is to use the 
coincidence of certain events in the dynamics of different neural units for 
binding. This is a dynamic binding. Usually, dynamic binding is represented 
by synchronous neurons or neurons that are in resonance with and external 
field. However, dynamical events like phase or frequency variations usually 
are not very reproducible and robust. It is reasonable to hypothesize that 
brain circuits that display sequential switching of neural activity [Abeles et 
al., 1995] use the coincidence of this switching to implement dynamic binding 
of different WLC networks. 

In the conclusion we have to emphasize that for large inhibitory neural 
ensembles it is not necessary to have specific connections that satisfy the 
conditions formulated above for the existence and stability of the WLC dy- 
namics. If the connections are random, the neurons in the ensemble can be 
separated in three groups: (i) neurons that are weakly coupled with oth- 
ers (they behave like nearly independent elements), (ii) neurons with strong 
but close to symmetric connections (they form a Hopfield like network just 
with simple attractors), and (iii) neurons with nonsymmetric connections 
that demonstrate the WLC dynamics. Because the WLC dynamics is a 
structurally stable phenomenon, it is reasonable to hypothesize that the per- 
turbation of the third group by the first two does not destroy the switching 
activity. Recent computer experiments [Zhigulin, 2002] have confirmed this 
hypothesis. 
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Figure 1: Left panel: phase protrait corresponding to the autonomous WLC 
dynamics of a three-dimensional case. Right panel: projection of a nine- 
dimensional heteroclinic orbit of three inhibitory coupled FitzHugh-Nagumo 
spiking neurons in a three dimensional space (the variables ^i, ^3, .^3 are 
linear combinations of the actual phase variables of the system [Rabinovich 
et al., 2000b]) -see also Sec. 5.1-. 
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Figure 2: The local map in a neighborhood of a saddle point. 
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Figure 3: 3D projection of the 6-dimensional system (30) showing examples of 
trayectories falling into the limit cycle from different initial conditions. As the 
numerical results indicate, this limit cycle in the vicinity of the former heteroclinic 
contour is a global attractor 
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Figure 4: Time series sliowing the switching of activities in a network of six 
neurons described by equations (30). Units are dimensionless. See parameters 
used in the text. 
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Figure 5: Temporal patterns produced by three simultaneously sampled PNs 
in the locust antennal lobe when two different odors are presented during 
the time interval from 1000 to 2000 msec. The horizontal bar indicates the 
time interval when the stimulus was presented (see [Wehr & Laurent, 1996] 
for details). 
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Figure 6: Spatio-temporal patterns generated by a network of nine FitzHugh- 

Nagumo neurons with inhibitory connections. We used the external stimuli: 
5i = 0.1, ^2 = 0.15, ^3 = 0, ^4 = 0, Sn = 0.15, Sq = 0.1, S7 = 0, Sg = 0, 
^9 = 0, r2 = 3.1 (left), and Si = 0.01, ^2 = 0.03, ^3 = 0.05, 5*4 = 0.04, 
^5 = 0.06, ^6 = 0.02, ^7 = 0.03, ^8 = 0.05, ^9 = 0.04, ra = 4.1 (right). We 
plot Xi{t) versus time. 
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Figure 7: Left panel: Schematic representation of the statohth motion inside 
the statocyst, the gravimetric organ of the moUusk Clione. Right paneh 
inhibitory connections used in the network model of the statocyst receptor 
neurons (thicker traces mean stronger inhibition). 
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Figure 8: Projections of the attractor from the six-dimenional phase space 
of the statocyst receptor network to two different three-dimensional spaces. 
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